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In  the  development  of  the  Great  Society,  both  the  executive  and 
legislative  branches  of  government  seem  to  have  decided  that  cost 
effectiveness  analysis  is  definitely  "in"  as  a  tool  for  planning  and 
operational  control.  The  voice  of  the  cost  analyst,  like  that  of  the 
turtle,  is  now  heard  throughout  the  land.  What  this  means  in  an  oper¬ 
ational  sense  is  that  the  modern  executive  now  feels  completely  com¬ 
fortable  only  when  he  has  his  cost-effectiveness  analyst  sitting  behind 
and  slightly  to  the  right  of  him  when  he  is  called  upon  to  justify  his 
decisions . 

For  the  cost  analyst  this  is  heady  wine  indeed,  and  it  would  be 
easy  to  give  in  to  the  temptation  to  expand  in  all  directions  and  set 
onea.elf  up  as  an  expert  on  all  things  from  strategy  to  sanitation. 

There  are  two  ideas  which  have  motivated  this  paper,*--  first, 
that  the  role  of  the  cost  analyst  is  not  to  appear  after  decisions  are 
made  and  provide  some  kind  of  estimate  which  justifies  the  decisions; 
and,  secondly,  that  cost  analysis  is  not  an  activity  which  is  carried 
out  by  itself,  but  Is  an  important  part  of  a  larger  analytic  activity 
which  is  sometimes  called  systems  analysis,  sometimes  cost-effective¬ 
ness  analysis,  and  sometimes  cost-utility  analysis.  This  larger  activ¬ 
ity  attempts  to  examine  alternative  means  of  achieving  specific  goals 
with  the  ultimate  intention  of  making  the  best  possible  decisions. 

The  main  intent  of  this  paper  is  to  show  how  the  cost  analyst  can  use¬ 
fully  participate  in  this  analytic  process  and  provide  insights  which 
contribute  to  the  making  of  the  aforementioned  "best  possible  decisions.^ 


Any  views  expressed  in  this  paper  are  those  of  the  authors.  They 
should  not  be  interpreted  as  reflecting  the  views  of  The  RAND  Corporation 
or  the  official  opinion  or  policy  of  any  of  its  governmental  or  private 
research  sponsors.  Papers  are  reproduced  by  The  RAND  Corporation  as  a 
courtesy  to  members  of  its  staff. 
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A 8  a  vehicle  for  illustrating  what  we  view  to  fc;  the  role  of 
cost  analysis,  we  shall  use  simplified  examples  from  a  recent  RAND 
study.  The  particular  study  selected  is  one  which  examines  alterna¬ 
tive  configurations  of  one  weapon  system  with  a  particular  mission. 
This  type  of  analysis  is  equally  applicable  to  comparisons  among  alter 
native  weapon  systems  or  alternative  force  postures. 

At  this  point  it  is  worth  examining  the  way  in  which  a  cost  ana¬ 
lyst  views  such  a  study.  Generally  speaking  it  may  be  considered  as 
having  five  major  phases,  beginning  with  the  formulation  and  defini¬ 
tion  of  the  study,  its  goals  and  its  framework,  and  ending  with  the 
presentation  of  the  results.  The  design  decisions,  to  which  the  cost 
analyst  can  contribute  significantly,  comprise  the  three  middle  phases 
of  the  study:  equipment  design,  system  design,  and  force  structure 
design.  These  five  phases  are  depicted  and  defined  in  Table  1.  It 
must  be  noted  here  that  the  three  design  phases  do  not  always  occur 
sequentially.  For  example,  one  might  begin  a  study  by  analyzing  pos¬ 
sible  deficiencies  in  the  force  structure  of  the  future,  and  then  pro¬ 
ceed  to  equipment  and  system  design  to  meet  the  deficiency. 

Let's  begin  our  illustration  by  assuming  that  a  deficiency  is 
possible  in  our  defense  forces  in  some  future  year,  N,  to  meet  a 
possible  threat  from  sea- launched  ballistic  missiles.  Without  ex¬ 
plaining  why,  let's  further  assume  that  we  are  interested  in  an  air¬ 
borne  patrol  defense  system  as  opposed  to  a  land-based  defense  sys¬ 
tem.  The  aircraft  in  the  system  would  patrol  sections  of  a  defense 
zone  extending  a  given  number  of  miles  out  from  each  coastline  of  the 
United  States.  Each  aircraft  would  be  equipped  with  surveillance  and 
tracking  radars  and  defense  missiles.  Figure  1  illustrates  our  area 
defense  system  and  also  provides  a  basis  for  the  logical  development 
of  the  resource  model  which  we  must  develop  before  any  cost  estimates, 
and  therefore  any  cost  analysis  can  be  made. 

This  works  as  follows:  on  the  one  hand,  the  extent  of  coverage 
of  the  defense  zone  is  contingent  upon  our  definition  of  the  probable 
threat  --  more  specifically,  upon  the  range  of  an  enemy  SLUM  (sea- 
launched  ballistic  missile).  On  the  other  hand,  the  effective  area 
(or  "patrol  station")  which  can  be  defended  by  any  single  aircraft  cu 


area 
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patrol  depends  upon  the  performance  of  Its  defense  missiles  (range, 
speed,  etc.)*  These  two  factors,  then  --  the  extent  of  the  defense  zone 
and  the  effective  radius  of  action  of  each  patrolling  aircraft  --  serve 
as  the  controlling  parameters  which  determine  the  requirement  for  air¬ 
craft  and  missiles  on  station.  Once  having  determined  the  number  of 
patrol  stations  required,  we  can  enlarge  our  rationale  (or  actually 
our  model)  to  Include  the  other  resources  necessary  to  turn  this  con¬ 
cept  Into  a  weapon  system;  namely,  backup  aircraft  and  missiles,  air 
bases,  trained  personnel,  ground  support  equipment,  etc. 

To  get  on  with  our  analysis,  let's  assume  that  a  system  has  been 
designed,  made  up  of  aircraft  and  missiles  whose  performance  has  been 
detailed  and  whose  operational  concepts  have  been  defined.  This  sys¬ 
tem  we  shall  call  the  "base  case"  system.  Its  characteristics  are 
presented  in  Table  2.  Based  on  these  characteristics  we  can  make  a 
preliminary  cost  estimate  for  the  system,  which  is  presented  In  Table  2. 


Table  2 


BASE  CASE  SYSTEM 


Extent  of  Coverage 
Missile  Performance 
Aircraft  Endurance 
System  Fully  Operational  in 
Operation 

Maintenance  Policy 

System  Cost  (Research  and 
Development;  Initial  Invest¬ 
ment  and  5  years  of  operation)  Approximately  $18  billion 

Now  let's  examine  this  cost  in  the  light  of  the  design  and 
operational  decisions  that  have  been  made  and  see  how  such  an  exami¬ 
nation  can  contribute  to  the  study  as  a  whole. 

First,  let's  look  at  the  performance  of  the  defense  missile  and 
see  what  significance  it  has  from  a  resource  standpoint.  Figure  2 
Illustrates  the  relationship  between  the  extent  of  the  defense  zone 
and  the  number  of  air  stations  required,  assuming  the  use  of  a  missile 


500  Nautical  Miles  Out 
X 

12  Hours 
Year  N 

Continuous  Airborne  Patrol 
One  Shift  Per  Day  (8  Hours) 


Extent  of  defense  zone  (n  mi  out) 


Fig. 2— Air  station  requirements 
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with  capability  X.  It  Is  easily  seen  that,  for  a  defense  rone  extend¬ 
ing  500  miles  out  we  would  require  40  air  stations.  This  requirement 
for  40  air  stations  translates  (for  the  base  case  system)  Into  a  need 
for  resources  which  can  be  expressed,  In  cost  terms,  as  $18  billion 
(for  research  and  development,  initial  Investment  and  five  years  of 
operation) . 

All  of  the  foregoing  has  assumed  a  missile  with  capability  X. 

We  must  recognize  that  since  we  are  dealing  with  a  future  weapon  system 
there  exists  always  the  possibility  of  some  technological  advancements 
and  we  would  certainly  want  to  provide  some  insights  as  to  the  possible 
effects  of  such  advancements.  As  an  example,  let's  look  at  the  effect 
of  the  development  and  use  of  a  missile  with  enhanced  capability  (call 
it  Y)  upon  our  system  resource  requirements.  Figure  3  compares  the 
requirement  for  air  stations  for  varying  defense  zones  using  either 
missile  X  or  Y.  Using  the  context  of  the  assumptions  of  the  base 
case,  it  is  evident  that  the  use  of  missile  Y  reduces  the  requirement 
for  air  stations  from  40  to  27.  It  may  also  be  noted  that  the  percent¬ 
age  decrease  In  air  stations  is  greater  as  the  defense  zone  Increases. 
This  might  be  Important  in  the  event  that  the  threat  turns  out  to  be 
greater  than  anticipated. 

It  must  be  realized  that  the  development  and  procurement  of  such 
an  enhanced  capability  missile  would  cost  something,  which  could  then 
be  weighed  against  the  cost  advantage  of  the  reduction  in  air  stations. 

We  can  next  focus  our  attention  on  the  aircraft  selected  to  carry 
the  missiles.  Here  we  would  hope  to  provide  Insights  as  to  the  desir¬ 
able  (from  a  coat  standpoint)  characteristics  of  the  aircraft.  Since 
this  aircraft  Is  assumed  to  remain  on  continuous  patrol,  a  key  perform¬ 
ance  factor  would  appear  to  be  the  length  of  time  the  aircraft  could 
remain  aloft,  which  we  call  aircraft  endurance. 

The  aircraft  we  postulated  for  the  base  case  system  had  a  maxi¬ 
mum  endurance  of  12  hours.  To  examine  the  effect  of  this  assumption 
on  resource  requirements  we  have  postulated  system  configurations  using 
types  of  aircraft  with  greater  endurance.  These  aircraft  are  of  an 
advanced  type,  having  turboprop  engines,  and  are  designed  primarily  for 
endurance  without  regard  to  apeed.  Figure  4  shove  the  relationship  of 
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aircraft  endurance  to  number  cf  aircraft  required  for  a  system  equipped 
wHh  the  advanced  misails  but  having  all  other  characteristics  of  th* 
base  case.  It  seems  clf-ar  that,  with  higher  endurance  there  is  a  lessen¬ 
ing  of  resource  requireoitnts ,  up  to  approximately  24  hours'  endurance, 
beyond  which  increased  aircraft  endurance  has  a  minimal  payoff.  Here 
again,  one  would  wish  to  make  the  seme  type  of  comparison  between  the 
cost  of  the  system  using  the  » riginat  ax-eraft  with  12  hours'  endurance 
and  the  cost  of  the  system  with  the  advanced  design  aircraft  with  24 
hours'  endui^.ice.  In  essence  —  does  the  saving  in  number  of  aircraft 
required  outweigh  the  development  and  incremental  procurement  cost  of 
the  advanced  aircraft?  Here  again  we  are  able  to  take  account  of  the 
possible  uncertainty  about  our  estimate  of  the  threat.  In  Fig.  5 
additional  configurations  have  been  added  to  illustrate  the  resource 
significance  of  aircrafr  endurance  if  the  required  defense  zone  Is 
greater  or  less  than  we  presently  contemplate.  It  can  be  seen  that 
endurance  become-  more  significant  as  the  defense  zone  increases.  We 
mijiht  then  become  interested  in  an  aircraft  with  36  hours'  endurance 
or  more. 

The  foregoing  examples  have  been  selected  to  show  the  kinds  of 
contributions  the  cost  analyst  could  make  in  the  equipment  design 
pi.ase  of  a  study.  At  the  very  least  this  type  of  analysis  can  point 
out  some  high  payoff  areas  which  are  worthy  of  further  investigation 
by  the  equipment  designers.  It  £>es  without  saying  that  in  order  to 
make  such  contributions  the  cost  analyst  must  be  a  participant  at  the 
beginning  of  the  study. 

Now  let's  talk  about  how  we  plan  to  operate  the  system,  and  the 
coat  significance  of  the  assumptions  we  make  about  system  operation. 

In  examining  an  aircraft  syutem,  or  any  other  system,  for  that  matter, 
one  is  tempted  to  dwell  upon  the  tactical  aspects  --  the  flying,  the 
mission,  and  other  interesting  aspects  of  the  activity  —  forgetting 
*-hat,  as  with  an  iceberg,  the  significant  aspects  may  not  be  immedi¬ 
ately  visible  ‘there  is,  however,  no  way  of  getting  around  the  fact 
that  a  significant  part  of  the  cycle  time  of  any  aircraft  is  devoted 
to  rvi-misaion  activities.  It  would  appear  well  worth  while  to  ex¬ 
amine  the.3e  nen- flying  parts  of  the  aircraft  cycle  to  determine  if 
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the  assumptions  made  about  them  have  any  great  cost  significance. 

Figure  6  depicts  what  we  envision  as  the  aircraft  cycle  for  the  mis¬ 
sion  we  are  examining. 

To  illustrate  what  we  mean  by  cost  significance  in  chis  area, 
let’s  focus  upon  one  aspect  of  the  ground  activities.  In  the  base 
case  we  assumed  a  one-shift  mairtenance  policy,  which  means  that 
trained  personnel  would  be  available  t<~>  inspect  and  repair  the  air¬ 
craft  and  missiles  for  an  eight-hour  period  each  day,  seven  days  a 
week.  This  also  means  that  aircraft  requiring  maintenance  during  the 
remainder  of  each  24-hour  day  would  be  obliged  to  await  the  following 
day’s  shift.  Since  we  have  already  noted  the  important  effect  of  air¬ 
craft  endurance  upon  the  resource  requirements,  and  since  it  would 
appear  reasonable  to  assume  that  the  frequency  with  which  an  aircraft 
is  forced  to  return  to  base  could  be  related  to  its  maintenance  re¬ 
quirements,  let’s  start  by  again  looking  at  the  relationship  (already 
presented  in  Fig.  4)  between  endurance  and  number  of  aircraft  required, 
given  the  single-shift  maintenance  policy.  (For  convenience  the 
relationship  is  repeated  in  Fig.  7.) 

What  if  we  decrease  the  wait  for  maintenance  by  increasing  the 
number  of  shifts  to  two  or  three?  Figure  8  shows  how  this  would  sub¬ 
stantially  lessen  the  requirement  for  aircraft,  especially  if  the  air¬ 
craft  have  short  endurance.  We  could  then  proceed  to  comoare  the 
additional  cost,  in  terms  of  personnel,  with  the  cost  savings  in 
terms  of  aircraft. 

By  putting  together  such  analyses  as  the  foregoing,  and  others 
which  we  haven't  mentioned,  we  are  at  last  able  to  look  at  an  ex¬ 
tremely  cost-significant  aspect  of  our  system:  the  actual  use  we  can 
get  out  of  our  aircraft.  This  is  a  most  important  point  precisely 
because  the  cost  of  the  aircraft  is  a  major  part  of  our  total  system 
cost,  and  the  use  we  can  make  of  each  aircraft  will  determine  how  many 
we  must  buy.  The  -ate  of  aircraft  utilization,  as  we  view  it,  depends 
upon  many  policy  decisions  (similar  to  that  made  about  maintenance 
policy).  These  policies  are  capable  of  being  changed  if  necessary, 
and  It  is  incumbent  upon  the  cost  analyst  to  point  out  cost  signif¬ 
icant  possibilities  in  this  area  too. 
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Fig.  6 
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How  the  system  costs  are  affected  by  the  rate  of  aircraft  utili¬ 
zation  is  illustrated  in  Fig.  9.  Note  how  a  10  percent  increase  in 
the  rate  of  utilization  from  40  to  50  percent  decreases  system  costs 
by  approximately  15  percent. 

To  examine  a  different  comparison,  let  us  envision  the  possibility 
that  when  this  system  will  be  operational  there  will  be  adequate  warn¬ 
ing  of  an  enemy  SLBM  attack.  This  implies  that  we  could  perhaps  oper¬ 
ate  the  system  in  a  different  manner  by  keeping  our  aircraft  on  the 
ground  instead  of  in  the  air.  They  could  be  on  15-minute  alert  ready 
to  fly  out  and  patrol  their  stations  in  the  event  of  a  crisis. 

On  the  face  of  it  we  would  expect  that  a  system  with  aircraft 
mostly  on  ground  alt  rt  would  be  considerably  less  costly  than  one  with 
aircraft  on  continuous  patrol.  Figure  10  provides  a  comparison  of 
these  costs.  If  the  system  had  50  percent  aircraft  utilization,  it 
would  appear  to  be  approximately  25  percent  cheaper  to  operate  it  in 
a  ground  alert  mode  than  on  continuous  airborne  patrol.  It  is  most 
interesting,  however,  to  note  uhat  approximately  the  same  cost  savings 
could  be  realized  for  either  system  by  increasing  aircraft  utilization 
by  about  20  percent. 

There  are,  of  course,  many  other  possible  modes  of  operation  for 
such  a  system,  and  it  is  not  necessary  for  the  cost  analyst  to  provide 
costs  for  all  possibilities.  He  can,  however,  provide  some  general 
insights  by  pointing  out  the  effect  on  costs  of  variation  in  some  of 
the  most  cost-significant  areas. 

The  final  area  in  which  th's  type  of  analytic  process  could  con¬ 
tribute  is  the  area  of  force  structure  design.  This  is  essentially 
the  point  at  which  the  decisions  must  be  made  as  to  when  and  how  the 
weapons  capability  already  discussed  will  be  introduced  into  the  total 
force.  From  an  analytical  standpoint  this  involves  a  series  of  steps 
which  take  the  weapon  system  concepts  and  place  them  in  a  total  force 
framework.  For  our  purposes,  this  would  occur  more  or  less  in  the 
following  fashion: 

1.  We  establish  for  purposes  of  analysis  and  comparison  a  "base- 
case"  force,  which  for  our  illustration  would  be  the  (Continental  De¬ 
fense  Forces)  portion  of  Program  I  of  the  DOD  Force  and  Financial  Pro- 


Total  system  costs  (billion  $) 


Aircraft  utilization  (%) 


Fig.  10 — Cost  versus  percent  of  utilization 
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gram.  This  base-case  force  and  the  resulting  costs  would  be  extrapo¬ 
lated  from  the  budget  year  for  as  many  years  in  the  future  as  required 
by  the  analysis  to  furnish  a  proper  context  within  which  to  view  the 
new  capability.  We  then  estimate  the  cost  of  this  program  on  a  year- 
by-year  basis. 

2.  We  add  to  the  base  case  force  the  ASLBM  system,  and  estimate 
the  cost  of  the  new  force  structure,  which  Includes  the  ASLBM  system, 
over  the  same  time  period.  Figure  11  Illustrates  the  cost  estimate, 
expressed  in  Total  Obligational  Authority,  for  the  base  case  force 
and  the  new  force  which  we  may  call  Variation  1. 

3.  We  may  also  wish  to  examine  the  year-by-year  cost  impact  of 
such  things  as:  a)  phasing  out  some  portion  of  the  existing  force,  or 

b)  changing  the  force  sire  of  the  proposed  ASLBM  weapon  system,  or 

c)  rescheduling  either  its  introduction  into  the  force  or  the  phase-in 
sequence.  One  reason  to  carry  out  such  examinations  could  be  our  un~ 
certainty  about  the  nature  of  the  threat  or  of  the  probable  state  of 
the  art  in  the  future  time  period  we  have  been  discussing.  Figure  12 
shows  again  the  base-case  force  and  Variation  1  projections  and,  in 
addition,  projections  of  two  additional  variations.  These  variations 
(2  and  3)  show  the  effect  on  the  force  costs  of  a  compressed  develop¬ 
ment  and  procurement  program  (Variation  2)  and  also  of  a  stretched- 
out  program  wherein  the  system  would  be  phased  into  the  force  in  four 
equal  stages  from  Year  N  through  Year  (N+3)  (Variation  3). 

In  this  comparison  ve  can  see  that  although  in  all  three  force 
variations  the  system  cost  of  the  ASLBM  system  Is  reasonably  comparable, 
nonetheless  changes  In  the  phase-in  sequence  have  serious  consequences 
in  terms  of  the  funds  that  would  have  to  be  obligated  in  specific 
years.  Although  this  may  not  have  any  significance  from  a  cost-effec¬ 
tiveness  standpoint,  It  can  nonetheless  be  a  crucial  consideration  for 
someone  who  is  obliged  to  make  force  structure  decisions. 

The  authors  hope  that  the  foregoing  discussion  and  illustrations 
have  been  Informative  and  feel  that  the  following  pointa  may  be  made 
In  cone lua Ion: 

1.  Coat  la  a  vitally  Important  criterion  in  decialonmaklng. 

2.  The  coat  analyst  can  provide  meaningful  inaighta  into  the 
effect  upon  ccjta  of  charges  in  the  design  or  operation  of  a  proposed 
ayetem. 
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3.  The  cost  analyst,  given  the  opportunity,  car  point  out  areas 
for  further  study  which  promise  high  payoff  in  terms  of  weapon  system 
cost  reduction. 

4.  To  do  this  job,  the  cost  analyst  must  be  brought  into  the 
study  21  the  beginning,  before  the  major  design  and  operational 
decisions  have  been  made. 

In  short,  we  might  say  that  the  proper  role  of  the  cost  analyst 
is  to  play  the  cost-effectiveness  game  and  not  be  just  the  scorekeeper. 


